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Abstract 

An Ornstein-Uhlenbeck (OU) process can be considered as a con- 
tinuous time interpolation of the discrete time AR(1) process. De- 
parting from this fact, we analyse in this work the effect of iterating 
OU treated as a linear operator that maps a Wiener process onto 
Ornstein-Uhlenbeck process, so as to build a family of higher order 
Ornstein-Uhlenbeck processes, OU(p), in a similar spirit as the higher 
order autoregressive processes AR(p). We show that for p > 2 we 
obtain in general a process with covariances different than those of an 
AR(p), and that for various continuous time processes, sampled from 
real data at equally spaced time instants, the OU(p) model outper- 
forms the appropriate AR(p) model. Technically our composition of 
the OU operator is easy to manipulate and its parameters can be com- 
puted efficiently because, as we show, the iteration of OU operators 
leads to a process that can be expressed as a linear combination of ba- 
sic OU processes. Using this expression we obtain a closed formula for 
the covariance of the iterated OU process, and consequently estimate 
the parameters of an OU(p) process by maximum likelihood or, as 
an alternative, by matching correlations, the latter being a procedure 
resembling the method of moments. 
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1 Introduction 



The Ornstein-Uhlenbeck process (from now on OU) was introduced by L. S. 
Ornstein and E. G. Uhlenbeck jUhlenbeck 1930| as a model for the velocities 
of a particle subject to the collisions with surrounding molecules. It improves 
Einstein's model (a Wiener process) because it also applies to fluids with 
finite viscosity, and since the 1950's is a well studied and accepted model for 
thermodynamics, chemical and other various stochastic processes found in 
physics and the natural sciences Gardiner , 2004 . Moreover, the OU process 



is the unique non-trivial stochastic process that is stationary, Markovian 
and Gaussian 



Mailer et al. , 2009 



Additionally it is mean-reverting, and 
for all these properties it has found its way into financial engineering, first 
as a model for the term structure of interest rates in a form due to IVasicekl 
|1977 , and then under other variants or generalisations (e.g. where the 
underlying random noise is a Levy process) as a model of financial time 
series with applications to option pricing, portfolio optimisation and risk 



theory, among others Nicolato and Venardos, 2003, Barndorff-Nielsen and 



Shephard 2001a[b Mailer et al. , 2009 and references there in]. 

The OU process can be thought of as continuous time interpolation of an 
autoregressive process of order one (i.e. an AR(1) process), a link that we 
shall make evident in Section [2] Beginning with this relation to the autore- 
gressive model, one can seek to define and analyse the result of iterating the 
application of the operator that maps a Wiener process on a OU process. 
Thus, in Section [3] a new family of processes is introduced: for each posi- 
tive integer p the Ornstein-Uhlenbeck processes of order p, denoted OU(p), 
are defined and proposed as models for either stationary continuous time 
processes or the series obtained by observing these continuous processes at 
equally spaced instants. The OU(l) processes are the ordinary Ornstein - 
Uhlenbeck processes. While the series obtained by sampling OU(l) processes 
at equally spaced times are autoregressive of the same order, this property 
does not extend in general for p > 1 as shown in Section |4j Hence, OU 
processes of higher order appear as a new model, competitive in a discrete 
time setting with higher order autoregressive processes (AR or ARMA). The 
estimation of the parameters of OU(p) processes is attempted in Section |5j 
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and examples showing the comparison of the proposed methods for that es- 
timation and the application of OXJ(p) models to real data are provided in 
Section |6j Section [7] contains our concluding remarks. 

2 Preliminaries 

Let us call w a standard Wiener process, that is, a Gaussian, centred process 
with independent increments with variance E(w(t) — w(s)) 2 — \t — s\. We 
impose further (as usual) that w(0) = 0, but shall not limit the domain of 
the parameter to R + and assume that w(t) is defined for t in R. Then, an 
Ornstein-Uhlenbeck process with parameters A > 0, a > can be written as 

=<*f e- x ^dw(s) (1) 

J — oo 

or, in differential form, 

dZxA*) = -K\,adt + adw{t) (2) 

We may think of £> )(T as the result of accumulating a random noise, with 
reversion to the mean (that we assume to be 0) of exponential decay with 
rate A. The magnitude of the noise is given by o. 

A widely used class of models for discrete time stationary series are the 
autoregressive process of order p, AR(p). They are obtained from a series 
W t of standard Gaussian independent random variables as 

p 

(1 _ - foB 2 <p P B p )x t = J](l + XjBfa = aW t 

i=i 

where B is the backshift operator that carries x t into Xt-i- Moreover, the 
innovations W t can be thought of as Wt = w(t) — w(t — 1) for a standard 
Wiener process w. The process x is stationary if | Aj | < 1 for all j = 1,2, ... ,p. 

When the Ornstein-Uhlenbeck process x is sampled at equally spaced 
times {it : i = 0, 1, 2, . . . ,n}, r > 0, the series Xi = x{ir) obeys an autore- 
gressive model of order 1, AR(1), since 
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/it /"(i+l)r 
e- x{iT - s) dw(s) + a e- x{{l+1)T - s) dw(s) = e~ Xr Xi + Z { 

-OO J IT 



where Z± = a j. e A ((' t+1 ) r ^dw(s) is a Gaussian innovation (independent 
of {w(t) : t < ir} and {x(t) : t < ir}) with variance 

Mi+l)T pO 2 

a 2 / e~ 2X « i+1 ^ds = a 2 / e 2Xs ds = £-(1 - e" 2 ^). 

Hence, we can consider the OU process as continuous time interpolation 
of an AR(1) process. Notice that both models are stationary. As we show 
in Section |4| the result of iterating the operator that carries Wiener process 
into Ornstein-Uhlenbeck process is not an interpolation of an autoregressive 
process. 



3 Ornstein-Uhlenbeck processes of order p 

Let OU\ be defined as the operator that maps aw onto £\ t(T (t), and also maps 
a differentiable process y(t),t G R onto 

OU x y(t) = f e- x ^dy(s), (3) 

J — oo 

when the integral converges. The definition is extended to include complex 
processes, by replacing A by k = A + A > 0, ju 6 R in Q . The set of 
complex numbers with positive real part is denoted by C + . 
For p > 1, the process 

v 

x = OU K (aw) := OU Kl OU K2 ■ ■ ■ OU Kp (aw) = J] OU K .{aw) (4) 

3=1 

will be called Ornstein-Uhlenbeck process of order p with parameters n = 
(«i, . . . , K p ) G (C + ) p and o > 0. The composition n?=i ®U. Ki * s unambigu- 
osly defined because the application of OU K , operators is commutative as 
shown in Theorem [I] ^ below. 

For technical reasons, it is convenient to introduce the Ornstein-Uhlenbeck 
operator OU^' of degree h with parameter k that maps y onto 

OU^{t)y{t) = e-^ { ~ K{t ~ ^ dy(s) (5) 
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and aw onto 

&{t)=af e W-«(*- ^ dw{s) (6 ) 



3.1 Properties 

The following statements summarize some properties of products (composi- 
tions) of the operators defined by Q and ([5]), and correspondingly, of the 
stationary centred Gaussian processes ft. = 0, 1, 2, ... . These processes 
will be called Ornstein-Uhlenbeck processes of degree h. In particular, the 
Ornstein-Uhlenbeck processes of degree zero £1°^ = £ K)(7 are the ordinary 
Ornstein-Uhlenbeck processes Q. 

Theorem 1. 

(zj VF/ien K2, the product OU K2 OU Kl can be computed as 



and zs therefore commutative. 

(ii) The composition YYj=i constructed with values of Ki, . . . , k p pair- 

wise different, is equal to the linear combination 



i[OU nj =Y t K j {K 1> ...,K p )OU Kj> (7) 

3=1 3=1 



with coefficients 



(Hi) For i = 1,2,... , OU K OU® = OUf - kOU^ 1) . 

(iv) For any positive integer p the p-th power of the Ornstein-Uhlenbeck 
operator has the expansion 

OUl = Y^( p - l )ouf. (9) 

3=0 V J ' 
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(v) Let Kx, . . . , K q be pairwise different complex numbers with positive real 
parts, and px, ■ ■ ■ ,p q positive integers, and let us denote by k a complex 
vector in (C + ) p with components Kh repeated ph times, ph > 1, h — 
1, — , q, Y%=xPh = V- Then, with K h (n) defined by (fsp, 



Corollary 1. The process 

g 

x = OU K {aw) = Yl OUl h h (aw) 

h=l 

can be expressed as the linear combination 

h=l j=0 

of the p processes {^£,a : h — 1, . . . , q, j — . . . ,pn — 1} (see 

Corollary 2. For real A,//, with A > 0, the product OUx +lfl OU\- lfl is real, 
that is, applied to a real process produces a real image. 

Proof of the Theorem and its corollaries: 

Parts (fzl) and dmj) are obtained by direct computation of the integrals, 



flz'z] ) follows from by finite induction, as well as (iv) from (Hi). 

From the continuity of the integrals with respect to the parameter k, the 
power OU p K satisfies 

OUl = \ymf[OU K+j5 = ^mj^K'^K^OU^ (11) 

j=l 3=1 

with 

K'A8,K,p) ' 



On the other hand, by 

n<M^ = limnn^^ = ftEE^C'^+A ( i2 ) 

ft=i fr=ij=i h=i j=i 
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where 5 = (Si, . . . ,S q ) 



Yli<h' 



( 1 _ K H'+? S H> ' 

<qA<f<Ph,(h',j')^(h,j)K L K h +j8 h ■ 



K'"(5,K)K'A8 h ,K h , Ph ), 



and 



rTi<^<^^n?:i(i - («* + avk + a)) 



— >■ Kh(n) as a | 



For the /i-th term in the right-hand side of (12), we compute 



Ph 



l^h)Ph)OlA Kh +jS h 

3=1 3=1 



Ph 

K ) ~ Kh^K'^Sh, K h ,p h )OU Kh+ j Sh 

3=1 



Ph 



+K h (K)\^Y, K '^K h , Ph )OU Kh+j5h = K h (K)OW K 



h 



3=1 



because of (jllj), since, in addition, each term in the first sum tends to zero. 
This ends the verification of Q. 

Corollary [I] is an immediate consequence of (iv) and fivty, and Corollary [2 
follows by applying to compute 



e -X(t-s) r^ (cos(/i(t - s )) +l sin ^ t - «))) 

o 

-^^(cos(//(t — s)) — 2sin(/i(t — s))) dw(s) 



x{t - s \cos(n(t -s)) + * sin(/i(t - s)))dw(s). 



□ 
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3.2 Computing the covariances 

The representation 

9 Ph f — 1 \ 
x = OU K (aw) = 53 Kh £ P*_ J OW^M 

h=l j=l ^ ' 

of x as a linear combination of the processes £kI,<t = OU$ (aw) allows a direct 
computation of the covariances ^(t) = Ex(t)x(0) through a closed formula, 
in terms of the covariances 7reT,«2,<r(i) = E^i^^^O): 



? Ph'- 1 q Ph"- 1 



h'=l i'=0 h"=l i"=0 ^ ' V ' 

with 

J-oo *1 ! l 2- 

h / • \ -ij /■() 

= t7 2 (-«i) il (-« 2 ) ia e-' sit V f Zl ] -4-r / e (Kl+S2)s (-s) il+i2 - J 'c/s 

i 2 ! ^j!(zi-i)!(Ki + K 2 )( il+i2 ^ +1 ) 1 J 

A real expression for the covariance when the imaginary parameters ap- 
pear as conjugate pairs is much more involved than this one, that contains 
complex terms. 



4 OU(p) is not an AR(^) 



The series of observations of an OU(p) at equally spaced times is not an 
AR(p) in general, for p > 1. Consider the autocorrelations of the time series 
obtained by evaluating x in multiples of a given instant r. If Xj = x(ir), 
then 

= EA-Xp = t(zt) 
Pi VarX 7(0) 
Lemma [T] shows through a direct computation of covariances that the family 
of series obtained from OU(2) are not in general AR(2) processes. 
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Lemma 1. Suppose x is a real 0U(2) process and X is a AR(2) process, with 
equal autocorrelations of order 1 and 2. Then, in general, the autocorrelations 
of order 3 are different. 

Proof: For the AR(2) process, if ri,r 2 ,r 3 are the autocorrelations of orders 
1, 2 and 3, these quantities satisfy the following relations: 



- 1 < n < 1, 2r{ - 1 < r 2 < 1, r 3 = —^{2r 2 -r{- r$) (15) 

1 r 1 

For the OU(2) process of real parameters Ai < A2, 



_ A KjK k e- x ^ _ Kfe~ Xlt Kje^ 1 i^i^e - * 1 * + e" A2 *) 
l{t) ~ ^ Xj + \ k ~ 2Ai + 2A 2 + A1 + A1 



j,k=i 



Aie" Al * A 2 e~ A2 ' AiA 2 (e~ Al< + e~ A2 ') 



2(A 2 -Ax) 2 2(A 2 -Ax) 2 (A 2 - Ai) 2 (Ai + A 2 ) 

Ai(Ai + A 2 )e- Alf + A 2 (Ai + A 2 ) e - A2f - 2A!A 2 ( e - Alt + e- A2t ) 
2(A 2 -A 1 ) 2 (A 1 + A 2 ) 

_ XijXi - A 2 )e- Alf + Aay-Ai + A 2 )e- A2t = A 2 e- A2t - Aie~ Alf 
2(A 2 -A 1 ) 2 (A 1 + A 2 ) 2(A 2 -A 2 ) 
From this equation we obtain 

7(0) = 2(ATTAi) 

and the correlations 

Ph = ~ r t~ , h = 1,2,3,... (16) 

A 2 — A\ 

The substitution A^/r for A^ shows that the same family of correlations is 
obtained for any value of r; hence, we can fix r = 1 without loss of generality. 
In particular, for p\ = r\ and p 2 = r 2 , we compute p 3 and r 3 as functions of 
Ai and A 2 using ( pT~5[ ) and (16). 

The plot of p 3 — r 3 in Figure [l] (a) shows that these results differ. In 
particular, Figure [I] (b) shows that the correlations of a certain OU(2) (o) 
and the AR(2) (x) process with ri = pi and r 2 = p 2 are not identical. 
These processes have been chosen to maximise |p 3 — r 3 |. The parameters are 
k = (0.84, 0.84) and r 3 - p 3 = 0.1032608. 
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(a) 



(b) 



Figure 1: (a) Differences of the third order correlations of OU(2) processes 
with real parameters Ai, A2 and the AR(2) processes with the same first two 
correlations, (b) The first ten correlations of two particular OU(2) (o) and 
AR(2) (x) processes with r\ = p\ and r 2 = p 2 . 

5 Estimation of the parameters of OXJ(p) 

5.1 Reparameterisation by means of real parameters 

Since we wish to consider real processes x and the process itself and its 
covariance j(t) depend only on the unordered set of the components of n, we 
shall reparameterise the process by means of the real vector <fi = (0i, . . . , P ) 
given by the polynomial identity 



5.2 Maximum likelihood estimation (MLE) 

We shall assume that the process \i + x is observed at times 0, r, 2r, . . . , nr. 
By choosing r the time unit of measure, we assume without loss of generality 



p 



v 




(17) 



The resulting process is real, because of Corollary [2} 
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that our observations are {/x + x(i) : i = 0, 1, . . . , n}. 

The likelihood L of the vector Ax = (x(l) — x(0), x(2) — x(l), . . . , x(n) — 
x(n — 1)) is given by 

logL(aj;0,<7) = -f log(27r) - § log(det(K(0, a)) - ±A:r tr (K(0, a))' 1 Ax 

with cr) equal to the n x n matrix with components 

V h ,i = 2 7 {\h - i\) - j{\h - i\ + 1) - j{\h 

that reduce to 2(7(0) — 7(1)) at the diagonal h = i. 

From these elements, a numerical optimisation leads to obtain the maxi- 
mum likelihood estimators of (p and a 2 of a 2 . If required, the estimations 



k follow by solving the analogue of the polynomial equation (17) written in 
terms of the estimators: 

f[(i+v) = i-E^- 

i=i 3=1 

The optimisation for large n and the solution of the algebraic equation 
for large p require a considerable computation effort, but there are efficient 



programs to perform both operations, as optim and polyroot in R (|R Devel- 
opment Core Team 2011| ). 



An alternative when the process is assumed to be centred (// = 0) is to 



maximise the log-likelihood of x = (x(0), x(l), . . . , x(n)) 

log L(x;cl>, a) = -f log(27r) - \ log(det(r(<£, a)) - \x^(Y{cf>,a))- l x 

where T has components Y h i = j(\h — i\) (h, i = 0, 1, . . . ,n). 

The optimisation procedures require an initial guess about the value of the 
parameter to be estimated. The estimators obtained by matching correlations 
described in the next section can be used for that purpose. 

5.3 Matching correlations estimation (MCE) 



From the closed formula for the covariance 7 (eq. (13)) and the relationship 



between k, and <p ( ec L- (17)), we have a mapping (0,cr 2 ) i-> j(t), for each t. 
Since p( y ) := (p(l), p(2), . . . , p(T)) tr = ( 7 (1), 7 (2), . . . , 7(T)) tr /7(0) does not 
depend on a 2 , these equations determine a map C : (4>, T) i-> p( T ) = C((f>, T) 
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for each T. After choosing a value of T and obtaining an estimate p e of 
p( T ) based on the empirical covariances of x, we propose as a first estimate 
of 4>, the vector (p T such that all the components of the corresponding n 
have positive real parts, and such that the euclidean norm \\pe —C((f> T ,T)\\ 
reaches its minimum. The procedure resembles the estimation by the method 
of moments. The components of pi^for the series (a?i)i=i,2,...,ra are computed 

as p e ,h = le,h/le,0, le,h = £ J27=l X i X i+h- 

5.4 Some simulations 

We have simulated the series x(i),i = 0, 1, 2, . . . , n obtained from an OU pro- 
cess x for n = 300 and three different values of the parameters and computed 
the MC and ML estimators T , and <p. The value of T for the MC estimation 
has been arbitrarily set equal to the integral part of 0.9 x n, but the graphs of 
4> T for several values of T show in each case that after T exceeds a moderate 
threshold, the estimates remain practically constant. One of such graphs is 
included below (see Figure [i]). 

The simulations show that the correlations of the series with the estimated 
parameters are fairly adapted to each other and to the empirical covariances. 
The departure from the theoretical covariances of x can be ascribed to the 
simulation intrinsic randomness. 

Our first two examples describe OU(3) processes with arbitrarily (and 
randomly) chosen parameters and the third one imitates the behaviour of 
Series A that appears in £j6j 

Example 1. A series (xi)i=o.i,...,n of n = 300 observations of the OU K pro- 
cess x (j> = 3, k = (0.9,0.2 + 0.4z0.2 — OAi), a 2 = 1) was simulated, and 
the parameters 4> = (—1.30, —0.56, —0.18) and a 2 = 1 were estimated by 
means of T = (-1.9245, -0.6678, -0.3221), T = 270, = (-1.3546, 
—0.6707, —0.2355) and a 2 = 0.8958. The corresponding estimators for 
k are ft = (1.6368, 0.1439 +0.4196^, 0.14389 -0.4196z) and k = (0.9001, 
0.2273 + 0.4582z, 0.2273 - 0.4582z). 

Figure [2] describes the theoretical, empirical and estimated covariances of 
x under the assumption p = 3, that is, the actual order of x. The results 
obtained when the estimation is performed for p = 2 and p = 4 are shown in 
Figure |3j Finally, Figure [4] shows that the MC estimates of <fi become stable 
for T moderately large, and close to the already indicated estimations for 
T = 270 (the horizontal lines). 
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Figure 2: Empirical covariances (o) and covariances of the MC ( — ) and 

ML ( ) fitted OU models, for p = 3 corresponding to Example 1. The 

covariances of OUk, are indicated with a dotted line. 



Covariances - p=2 Covariances - p=4 




Figure 3: Empirical covariances (o) and covariances of the MC ( — ) and ML 

( ) fitted OU models, for p = 2,4 corresponding to Example 1. The 

covariances of OU^ are indicated with a dotted line. 
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Figure 4: The MC estimations </>i(°), ^(v) and ^2(0) for different values of 
T, corresponding to Example 1. The horizontal lines indicate the estimations 
for T = 270. 



Example 2. The process x = OU( .o4,o.2i,i.87) is analysed as in Example 1. 
The resulting estimators are T = (-2.0611, -0.7459, -0.0553), T = 270, 
K = (1.6224, 0.3378, 0.1009), = (-1.8253, -0.7340, -0.0680), a 2 = 0.7842, 
ft = (1.3015, 0.3897, 0.1342), and the resulting covariances are shown in 
Figure [5] . 

Example 3. The parameter k, = (-0.83 - 0.0041 - 0.0009) used in the sim- 
ulation of the OU process x treated in the present example is approximately 
equal to the parameter k obtained by ML estimation with p = 3 for Series A 
in §6.1 As in previous examples, a graphical presentation of the estimated 



covariances is given in Figure |6J 

The description of the performance of the model is complemented by 
comparing in Figure [7] the simulated values of the process in 400 equally 
spaced points filling the interval (199,201) with the predicted values for the 
same interval, based on the OU(3) model and the assumed observed data 
x(0), x(2), x(3), . . . ,a:(200). Also a 2a confidence band is included in the 
graph, in order to describe the precision of the predicted values. 



6 Applications to real data 

In this section we present experimental results on three real data sets. We 
fit OU(p) processes for small values of p and also some ARMA processes. In 
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Covariances - p=3 





Figure 5: Empirical covariances (o) and covariances of the MC ( — ) and 

ML ( ) fitted OU models, for p = 3 corresponding to Example 2. The 

covariances of OU re are indicated with a dotted line. 



each case we have observed that we can find an adequate value of p for which 
the empirical covariances are well approximated by the covariances of the 
adjusted OU(p) model. This is not the case for the AR or ARMA models in 
all three examples. We present a detailed comparison of both methodologies 
for the first example. 



The first two data sets are taken from Box et al. 1994 , and correspond 



to equally spaced observations of continuous time processes that might be 
assumed to be stationary. The third one is a series obtained by choosing 
one in every 100 terms of a high frequency recording of oxigen saturation in 
blood of a newborn child. The data were obtained by a team of researchers 
of Pereira Rossell Children Hospital in Montevideo, Uruguay, integrated by 
L. Chiapella, A. Criado and C. Scavone. Their permission to analyse the 
data is gratefully acknowledged by the authors. 
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Covariances - p=3 




Figure 6: Empirical covariances (o) and covariances of the MC ( — ) and ML 

( ) fitted OU models, for p = 2,p = 4 and p = 3, the actual value of 

the parameter, corresponding to Example 3. The covariances of OUk, are 
indicated with a dotted line. 



6.1 Box, Jenkins and Reinsel "Series A" 

The Series A is a record of n = 197 chemical process concentration read- 
ings, taken every two hours, introduced with that name and analysed in 
Chapter 4 of |Box et aT| |1994] (see also |http://rgm2.1ab.nig.ac.jp/RG M2/ 
tfunc.php?rd_id=FitAR:SeriesA). The original data are plotted in Figure [8j 
The diagrams in Figure [9] compare the empirical covariances of the series 
with the covariances of the estimated ARM A(p, q) process fitted by means 
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1 — 

199.0 



199.5 



200.0 



200.5 



201.0 



Figure 7: Estimated interpolation and prediction of x(t) for 199 < t < 

200 and 200 < t < 201, respectively ( ), 2a confidence bands based on 

(x(i))j=o,i ) ...,2oo (• • • ), and a refinement of the simulation of x{t) on 199 < t < 
200. 



of the R function arima for several values of p and q. In particular, the 



ARMA(1,1) is suggested as a model for this data in Box et al. 1994 , and 



subsets of AR(7) are proposed in Cleveland 1971 and McLeod and Zhang 



The original series 




50 100 150 200 



Figure 8: Series A 
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Covariances of the fitted ARMA(1 ,2) process 



Covariances of the titted ARMA(1,3) proces 




^s^S, ^» 




Covariances of trie fitted ARMA(2,1) pi 




Covariances of the fitted ARMA(2 r 2) pro- 



is tilted ARMA(2,3) pro. 





Covariances of the fitted ARMA(3.2) pro- 




"-V- ■ 



te tilted ARMA(3,3) pro* 



Iflin- 



Covariances of the fitted ARMA(3,0) process 



Covariances ol the titted ARMA(7,0) proces 




Figure 9: Empirical and ARMA-fitted covariances for Series A 



2006 for the same purpose. 



The ARMA(1,1) and the AR(7) fit fairly well the autocovariances 
small lags, but fail to capture the structure of autocorrelations for large 
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C ova fiances - p=2 



Covariances - p=3 



C ova fiances - p=4 




Figure 10: Empirical covariances (o) and covariances of the MC ( — ) and ML 
( ) fitted OU(p) models, for p = 2, 3, 4 corresponding to Series A. 



present in the series However, the approximations obtained with the OU(3) 
process reflects both the short and long dependences, as shown in Figure [lOj 



Finally we show in Figure 11 the predicted values of the continuous pa- 
rameter process x(t) for t between n — 7 and n + 4 (190-201), obtained as 



1 94 1 96 

(n - 7):(n + 4) 



Figure 11: Confidence bands for interpolated and extrapolated values of 
Series A for continuous domain. 
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Figure 12: Empirical covariances (o) and covariances of the MC ( — ) and ML 
( ) fitted OU(p) models for p = 2, 3,4 corresponding to Series C. 



the best linear predictions based on the last 90 observed values, and on the 
correlations given by the fitted OU(3) model. The upper and lower lines are 
2cr-confidence limits for each value of the process. 



6.2 Box, Jenkins and Reinsel Series C 

The Series C is a record of n = 226 chemical process temperature readings, 
taken every minute, introduced with that name in Box et al. [1994] , p. 544. 



As in the previous example, the fitted ARMA(p, q) and ARLMA(j», 1, q) 
models for moderate values of p and q fail to capture the autocorrelations 



that might be present in the series. Figure 12 shows the empirical covariances 

of the series and the covariances of the MC ( — ) and ML ( ) fitted OU(p) 

models for p = 2, p = 3 and p = 4. It is not surprising that the MC estimated 
covariances fit better than the ML ones the empirical covariances, since they 
have been obtained by optimising that fit. The poor performance of the ML 
estimation is presumably due to the fact that the series does not obey an 
OU model. 

The corresponding graphs for the first differences of Series C are included 
in Figure [13} 



6.3 Oxigen saturation in blood 

The oxygen saturation in blood of a newborn child has been monitored during 
seventeen hours, and measures taken every two seconds. We assume that a 
series xo, xi, . . . , £304 of measures taken at intervals of 200 seconds is observed, 
and fit OU processes of orders p = 2, 3, 4 to that series. 
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Figure 13: Empirical covariances (o) and covariances of the MC ( — ) and ML 

( ) fitted OU(p) models for p = 2, 3, 4 corresponding to the first differences 

of Series C. 



i > . . *>v.--. 





Figure 14: Empirical covariances (o) and covariances of the MC ( — ) and ML 

( ) fitted OU(p) models for p = 2,3,4 corresponding to the series of O2 

saturation in blood. 

Again the empirical covariances of the series and the covariances of the 
fitted 0\J (p) models for p = 2, p = 3 and p = 4 are plotted (see Figure [m]) 
and the estimated interpolation and extrapolation are shown in Figure [15| 
In the present case, the actual values of the series for integer multiples of 
1/100 of the unit measure of 200 seconds are known, and plotted in the same 
figure. 



7 Conclusions and comments 

We have proposed a family of continuous time stationary processes based 
on iterations of a generalisation of the linear operator that maps a Wiener 
process onto an Ornstein-Uhlenbeck process. The 01] (p) family depends on 
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% 1 











300 301 302 303 304 305 



Figure 15: Partial graph showing the five last values of the series of 2 
saturation in blood at integer multiples of the 200 seconds unit of time (o), 

interpolated and extrapolated predictions ( — ), 2a confidence bands ( ), 

and actual values of the series. 

p + 1 parameters that can be easily estimated by either a maximum likeli- 
hood or matching correlations procedures. Matching correlation estimators 
provide a fair estimation of the covariances of the data, even if the model is 
not well specified. 

The families of OU(p) models can be used as an alternative to ARMA or 
AR models for the study of stationary time series. For p — 1, OU(l) observed 
at equally spaced time instants coincides with AR(1) but for larger values of 
p the covariances that can be described with OU(p) models are not in general 
the same as those given by the AR(p) models. In fact, the autocorrelation 
structure that might be present in the data for large lags can be modeled 
with OU(p) with small values of p, a fitting that the ARMA and AR models 
fail to accomplish. 
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